Papers with Automatic Essay Scoring
Automated Chinese Essay Scoring from Multiple Traits (2022.coling-1)
Copied to clipboard
| Challenge: | Current research on AES focuses on scoring the overall quality or single trait of prompt-specific essays. |
| Approach: | They propose a hierarchical multi-task trait scorer to evaluate quality of writing . they propose an inter-sequence attention mechanism to enhance information interaction . |
| Outcome: | The proposed model outperforms several strong models on ACEA and outperformed other models. |
TOREE: Evaluating Topic Relevance of Student Essays for Chinese Primary and Middle School Education (2024.findings-acl)
Copied to clipboard
Xinlin Zhuang, Hongyi Wu, Xinshu Shen, Peimin Yu, Gaowei Yi, Xinhao Chen, Tu Hu, Yang Chen, Yupei Ren, Yadong Zhang, Youqi Song, Binxuan Liu, Man Lan
| Challenge: | Existing research on Automatic Essay Scoring (AES) for Chinese essays has overlooked topic relevance and lacks detailed feedback. |
| Approach: | They propose to use TOREE to assess topic relevance in Chinese primary and middle school students’ essays to improve automatic and human evaluations. |
| Outcome: | The proposed method significantly improves both automatic and human evaluations across four diverse LLMs. |
Can Large Language Models Differentiate Harmful from Argumentative Essays? Steps Toward Ethical Essay Scoring (2025.coling-main)
Copied to clipboard
| Challenge: | Existing automated essay scoring systems overlook ethical and moral aspects of content, erroneously assigning high scores to essays that propagate harmful opinions. |
| Approach: | They introduce a Harmful Essay Detection benchmark to test the effectiveness of various Large Language Models (LLMs) they find that current AES systems overlook ethically and morally problematic elements in essays . |
| Outcome: | The proposed benchmark compared LLMs and AES models to identify and score harmful essays. |
Language Proficiency Scoring (2020.lrec-1)
Copied to clipboard
| Challenge: | a new paper evaluates and extends the results of an automated proficiency classification system for different languages. |
| Approach: | They propose to extend an automated essay scoring system proposed by CEFR . they compare results with those from previous paper and add a new corpus for english . |
| Outcome: | The proposed approach does not scale well with the added English corpus. |